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Abstract 



We prove a representation of the partial autocorrelation function (PACF) of a stationary process, or of the Verblunsky 
coefficients of its normalized spectral measure, in terms of the Fourier coefficients of the phase function. It is not of 
fractional form, whence simpler than the existing one obtained by the second author We apply it to show a general 
estimate on the Verblunsky coefficients for short-memory processes as well as the precise asymptotic behaviour, with 
remainder term, of those for FARIMA processes. 
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1. Introduction 

Let {X„ : n e Z) be a real, zero-mean, weakly stationary process, defined on a probability space (Q, 7^, P), with 
spectral measure not of finite support, which we shall simply call a stationary process. Here the spectral measure 
is the finite measure /i on (-tt, tt] in the spectral representation y(n) - J^^^^ e'"^^(dff) of the autocovariance function 
y{n) :— E{X„Xq\, n e 1. For {X„), we have another sequence {a(n))^i called the partial autocorrelation function 
(PACF); see ( 12.11 1 below for the definition. In the theory of orthogonal polynomials on the unit circle (OPUC), 
however, the PACF {ain)]'^^^ appears as the sequence of Verblunsky coefficients of the normalized spectral measure 
fi :- {fi{-n, n]y^ju. Notice that {-n, n] can be identified with the unit circle T := {z e C | |z| = 1) by the map i-> e'*, 
whence fioi ft with a measure on T. For a survey of OPUC, see Simon (2005a, 2005b, 2005c, 201 1). 

The Verblunsky coefficients {a(«)}^[ give an unrestricted parametrization of the normalized spectral measure fi 
of {X„}, in that the only inequalities restricting the a(n) are a(n) e [-1, 1], or a(n) e (-1, 1) in the non-degenerate case 
relevant here. This result is due to Barndorff-Nielsen and Schou (1973), Ramsey (1974) in the time-series context. 
However, in OPUC, the result dates back to Verblunsky (1935, 1936). See, e.g., Simon (2005b, 2005c) and Bingham 
(201 1) for background. 

The aim of this paper is to prove an explicit representation of the Verblunsky coefficients {a(n)}'j^^^ in terms of 
another sequence {/?„ defined by 



where {c„)J^q and {fln),tLo '■^^ coefficients of {X„}, respectively, defined by ( 12.3b below. See Inoue and 

Kasahara (2004 Section 3, 2006 (2.23)). We notice that /3„ correspond to the Fourier coefficients of the phase function 
of the process (see Remark [1] in §2). The proof of the representation of {a(n)} is based on the result of Inoue and 
Kasahara (2006) on the explicit representation of finite predictor coefficients as well as the Levinson (or Levinson- 
Durbin) algorithm or the Szego recursion. The algorithm is due to Szego (1939), Levinson (1947), and Durbin (1960); 
for a textbook account, see Pourahmadi (2001, Section 7.2). 
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We notice that, in Inoue (2008), the second author already proved a representation of {a(n))^j in terms of {y6„)^g. 
However, the representation of {Q'(n))J^j in the present paper is much simpler than that in Inoue (2008), in that the 
latter is of fractional form while the former not. We apply the result to show a general estimate of a{n) for short- 
memory processes as well as the precise asymptotic behaviour, with remainder, of a{n) for FARIMA processes. The 
FARIMA model is a popular parametric model with long memory, and was introduced independently by Granger and 
Joyeux (1980) and Hosking (1981). See Brockwell and Davis (1991, Section 9) for textbook treatment. The long 
memory of the FARIMA model comes from the singularity at zero of its spectral density. 

In §2, we state the main result, i.e., the representation of the Verblunsky coefficients. Its proof is given in §3. In 
§4, we apply the main result to both short-memory and FARIMA processes. 



2. Main result 

Let // be the real Hilbert space spanned by : k e Z) in L^(f2, ;F, P), which has inner product (Fi, 72) ■- E[YiY2] 
and norm ||y|| := (Y, F)'^^. For an interval / c Z, we write Hj for the closed subspace of H spanned by {X^ : k e 1} and 
Hf- for the orthogonal complement of Hj in H. Let Pj and Pf be the orthogonal projection operators of H onto H; and 
Hf, respectively. The projection PjY stands for the best linear predictor of Y based on the observations {Xk : k e I}, 
and Pf Y for its prediction error 

The PACF {a(n)}'^^^ of {X„} is defined by 

a(l):=ll-:, a(n) :^ ' ' ' ''■^ , « = 2,3,... (2.1) 

r(0) 

(cf. Brockwell and Davis (1991, Sections 3.4 and 5.2)). As stated in §1, The PACF {a(n)}2,i coincides with the 
Verblunsky coefficients of the normalized spectral measure fi. In what follows, we also call {cK(n))J^j the Verblunsky 
coefficients of {X„}. 

Our main result, i.e.. Theorem 12. 1 1 below, is an explicit representation of {Qf(n))J^j. To state it, we need some 
notation. A stationary process {X„} is said to be purely nondeterministic (PND) if n^_;^//(_co.H] = {0), or, equivalently, 
there exists a positive even and integrable function A on (-tt, ji] such that | log l^{0)\d0 < CO and jn = e'"'^A{0)de 
for n e Z; see Brockwell and Davis (1991, Section 5.7), Rozanov (1967, Chapter II) and Grenander and Szego (1958, 
Chapter 10). We call A the spectral density of {X„). Using A, we define the Szego function h by 

{1 C e'^ +7 1 
— J -^logA(0)t/6»|, zeC, k|<l. (2.2) 

The function hiz) is an outer function in the Hardy space of class 2 over the unit disk |z| < 1 . Using h, we define 
the MA coefficients c„ and the AR coefficients «„, respectively, by 

Mz)=y°° -4T = y°° ki<i; (2.3) 

see Inoue (2000, Section 4) and Inoue and Kasahara (2006, Section 2.2) for background. Both {c„) and {a„] are real 
sequences, and {c„) is in fi. 

We write for the class of slowly varying functions at infinity: the class of positive, measurable {, defined on 
some neighborhood [A,oo) of infinity, such that \m\y:^oo({^x)l{(x) - 1 for all A > Q\ see Bingham et al. (1989, 
Chapter 1) for background. Among several possible choices of assumption on as in Inoue and Kasahara (2006), 
we consider 

(Al) [X„] is PND, and both Y^Zo < °° and Y.Zi) < ^ hold 
as a standard one for processes with short memory, and 

(A2) {Xn] is PND, and, for some d e (0, 1/2) and £ e Hq, {c„] and {a„] satisfy, respectively, 

n X n-t^i 1 ds,m{nd) 
Cn~n-^'-'H{n\ fl«~n"* 'ttt 
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as a standard one for processes with long memory. Here /?„ ~ ^„ as « — » oo means lim„^oo Pnlqn - 1- 

Recall /?„ from (II. lb . Notice that the sum in ( II. Il l converges absolutely under either (Al) or (A2). For n e N U {0), 
we define a\(n) :- /3„ and, for ^ = 3,5,7,..., 



As in the case of dk(n, j) in Inoue and Kasahara (2006, Section 2.3), the sums converge absolutely. We write 2°°" to 
indicate that the sum does not necessarily converge absolutely, i.e., 2^7n limM^oo Yjh^m- 
Here is the main result of this paper 

Theorem 2.1. We assume either (Al) or (A2). Then a{n) — Yjt^i ^2k-i(n)for n — 2,3, . . .. 

The proof of Theorem l2.1l is given in Section[3] 



Remark 1. We assume {fl„) e fi. As usual, we identify h with its boundary-value function h(e'^) = limrfi h{re'^). 
Then, since h{e''^) - Q^'*" and l/h(e'^) = - YjT^o e'^^flie'*", Parseval's identity yields 



Here notice that, in our set-up, {c„} is real. Thus yS„ (or, more precisely, -/5„) is the «-th Fourier coefficient of h/h. The 
function /;//; is called the phase function of the process. See Peller (2003, p. 405); see also Dym and McKean (1976) 
for its continuous-time analogue. 

3. Proof of Theorem |23] 

In this section, we assume either (Al) or (A2). For n e N, we can express f [_„,_i]Xo uniquely in the form 



We call (f>„j the finite predictor coefficients. The proof of Theorem l2.1l is based on the explicit representation of <;*„ j, 
i.e., ( I3.5l l below, and the following Szego recursion (or the Levinson-Durbin algorithm): 




I'i-i • 





4>n,j - 4>,nl,j - 'f>n,n+l-ja(n + 1), 



= l,...,n. 



(3.1) 



See, e.g., (5.2.4) in Brockwell and Davis (1991) for the latter 

As in Inoue and Kasahara (2006, Section 2.3), we define, for n, y e N U {0), 



do(n,j) ^ 6jo, 





and 




k>3. 



the sums converging absolutely. These satisfy the following recursion: for n, j e N U {0), 





(3.2) 



From the definition of a^in) above, we also have 





(3.3) 



The next proposition is the key to the proof of Theorem l2.1l 
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Proposition 3.1. For n,jeNU {0} and k eN, we have 

^^^a2k-2i+i(n)d2i-i(n,j). (3.4) 

Proof. Let n,j e N U {0). We use mathematical induction on k. First, since Q'i(n) - /3n and d\{n,j) - /3„+j, we 
have d2(n,j) - Yi'^=nPvPv+i — Q'i(v)(ii(v, y), which implies ( 13.41 ) with k - \. Next, we assume that ( I3.4l i holds 
for^ e N. Then, by (I3.2l l and the Fubini-TonelU theorem, we have d2k+i{n, j) - Yj7^=Q[Yj7i=nPvi+v\Pi+vAd2k{n,V2), 
whence d2k+2{n, ]) - d2k+2{n + 1, /') = I + II, where 

I := 'Yjv,=o [Xiv,=o^"+''2+'''^"+-''+''' ['^2*:(«, V2) - d2k(n + 1, V2)] , II := ^^_^^^jy6«+i.,/?«+;'i2/t(n + 1, V2). 
By i3.2i . (I3.4l i. and the Fubini-Tonelli theorem, 

^ ^ Xi,,=o [Xi,i=o^"+'-+"^"+-''+'''] X/=i "z^-Z'+iW^^zz-Kn, V2) 

= 2_//=i "2k-2i+i(n)d2i+i(n, j) = 2_^^^^ a2{k+\)-2i+\{n)d2i-\{nJ), 

while, by (13.31 1. we have II - [YjZ=o/^n+v,d2k(n + 1, V2)]/3„+) = a2k+i{n)d\{n, j). Thus we obtain (13.4b with ^ replaced 
by + 1, as desired. □ 

For « e N and j - Theorem 2.9 in Inoue and Kasahara (2006) asserts the representation 

{b2k-\(n, j) + b2k(n, n+l-j)}, (3.5) 

where ^ 

bk(n, j) = Co ^^^^Q aj+udk-i{n + !,«), ^=1,2,.... (3.6) 

Using Proposition 3. 1, we derive two kinds of difference equations for bk(n, j). 
Proposition 3.2. For n,k eN and j - we have 

Zk 
i^^a2k-2i+i(n + l)b2i(n, j), (3.7) 

Zk 
a2k-2i+i(n + l)b2i-i(n, n + l- j). (3.8) 

Proof. From (13.41 ) and (13.61 ). we easily obtain ( 13.7b in the following way: 

Zoo 
aj+u{d2k{n +!,«)- d2k(n + 2, m)) 

Zoo X"'* 
«=o'^-''+" Zj/=i '^2*-2;+i(n + l)d2i-\{n + 1,m) 

/ -^oo \ 

a2k-2i+\{n + 1) ko 2_^^^^^aj+ud2i-i{n + 1, m) 1 = 2^^^^ Q'2A-2/+i(n + l)^2/(n, j)- 
We turn to ( 13.8b . Since d\(n + \ , u) - a\{n + \ + u) and Z7i(n, j) - cofl/, it follows from (13.6b that 

Zoo \— ^ 00 
a„+x^j+udx{n + \,u) ^ } ai(u)bi(n,u- j). 

Similarly, h2(n + 1, n + 2 - y) = co Y^=f, On+2-j+ud\{n + 2,u) - 'Z!^=n+2 o!i{u)bi(n, u - j). Thus (13.8b holds for k = 1. If 
A: > 2, then, by (IT2l l and (l3?6b . we have 

Zoo 00 
^^^^fl„+i_y+„ 2_^^^^yS„+i+„+vJ2(t-i)(n + l,v), 

fe2i:(n + 1, n + 2 - ;■) = Co ^j^^^j fln+i-j+» 2_;,,^o''^"+'+"+"^^<*"'>*-" ^' 



whence b2kin, n + I - j) - b2k(n + l,n + 2 - j) - I + II with 

I := Co ^^^^Q cin+i-j+i, Id2(jc-i)(n + 1, v) - d2(k-i)(n + 2, v)} , 

Zoo 
^,^^/3n+i+vd2(k-r)(n + 2, v). 

By dH and 

Zoo -^—foo -^--rk-l 

u^o''"+^-j+" Z^y=of^"+^+"+'- Z^i=i "2(k-i)-2i+i(n + l)d2i-i(n + 1, v) 

(n+l,v)) 

= ^^^j a2(k-i)-2i+\(n + \)b2i+\{n,n+ 1 - ;) = ^^^^ "^^t-a+iCn + l)b2i-\(n,n + 1 - ;'), 
while, by ( I3.3l l and bi(n,n + \ - j) - can+\-j, we have II - a2k-\{n + \)b\{n, n + 1 - j). Thus ( 13.8b follows. □ 
We are now ready to prove Theorem 12. II 



Proof (of Theorem|2TJ. For n € N and /' = 1, . . . , n, we have b\(n, j) - bi(n + l,j) = coaj - coaj - 0. This, together 
with (Ell, dllli and yields 



{b2k+iin, j) - b2k+i(n + 1,7') + 02/t(n, n + 1 - - /72i(n + 1, n + 2 - 7)) 

Zoo- -^r-rk 
k=\ Zj;=i "^k-2i+i(n + 1) {fe2;(n, ;) + ^2/-i(n, « + 1 - ;)) 

= {/72;(n,;) + ^2;-i(n,n + 1 - ./)) Q'2t-2;+i(n + 1) = {Yjk=i"^'''^^" 



Since P[_„,_i]X() 0, we have (0„,i, . . . , 0„,„) 0. Combining these and (13. Il l, we obtain the theorem. □ 

4. Applications 

4.1. Short memory processes 

In this subsection, we apply Theorem l2.1l to the Verblunsky coefficients of short-memory processes. 
We define 

Then F(j) decreases to zero as j — > 00 under (Al). Recall dk(n, j) from Section[3] 
Lemma 4.1. We assume (Al). Then ^Zo \dk(n, u)\ < F{nf for k,neN. 
Proof. Let n € N. We use induction on k. Since di(n, u) - p„+u, we have 

Zoo V~1oo V~1oo 

\di(n, u)\= ) |y8„+„| < > , „ |Cv| > , „ |fl«+»+, I < ^'(n)- 

We assume ^I^^q |t/i(n, m)| < F{nf for ;t e N. Then, by (133 . 

^ l^/.+Kn, m)| < v)| ^J^^^ < F(n) ^"^^ |£/,(«, y)| < F(nf^'. 

Thus the inequality also holds for k + I. □ 

Notice that {a„} e ^' implies a,, — > as n ^ 00. 
Theorem 4.2. We assume (Al). Then, for N € N ^smc/i f/iof F(A^ + 1) < 1, the Verblunsky coefficients {a(n)} satisfy 

1 - F(n + 1)^ \ j>« / 
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Proof. Recall a2k+\(n) from §2. We have laKn)! - \fi„\ < (ma\j>„ \aj 

l) 2r=o Ic.'l- By ((331) and Lemma Ol we also 

have \a2k+i(n)\ < Y^ZolPn+vdikin + l,v)| < F(n + l)^'' {max j>„ \a j\) Y,Zo l^vl for n,k e N. Choose e N so that 
F(N + 1) < 1. Then, combining the estimates above with Theorem l2.1l we see that, for n > N, 

\ain)\ < (max \aj\] V ^ |c„| V °° F(n + 2 (^^'^ 

\ j>n I ^v=0 Z^k=0 1 _ f(n + ly \ j>n 

Thus the theorem follows. □ 

For example, if, in addition to (Al), a„ = 0{n^'') as n — > 00 for some p > I, then maxj>„ \aj\ - OirT''), whence, 
by Theorem l4.2l a{n) - 0(n^'') as n — > 00. 



4.2. The FARIMA model 

For d e (-1/2, 1/2) and p,q e N U {0), a stationary process {X„} is said to be a FARlMA{p, d,q) (or fractional 
ARIMA(;7, d, q)) process if it has a spectral density A of the form 

^ ' In \(S>(e'0)\2 

where 0(z) and &{z) are polynomials with real coefficients of degrees p, q, respectively, satisfying the following 
condition: (S>(z) and 0(z) have no common zeros, and have no zeros in the closed unit disk {z e C | |z| < 1). 

In what follows, we assume that {X„} is a FARIMA(/5, d, q) process with < li < 1/2. Then {X„] satisfies (A2) for 
some constant function I (cf. Inoue (2002, Corollary 3.1)). Let {a{n)] be the Verblunsky coefficients of {X„). The aim 
of this subsection is to apply Theorem l2.1l to {a{n)) to prove the next theorem. 

Theorem 4.3. We have na{n) - d + 0(n^'') as n ^ 00. 



Theorem 14.31 is more precise than Inoue (2008, Theorem 2.5) with < li < 1/2, in that the former gives an 
estimate on the remainder term. The rest of this subsection is devoted to the proof of Theorem l4.3l 

As before, we denote by {c„} and {a„} the MA and AR coefficients, respectively, of {X„}. We also consider a 
FARIMA(0, d, 0) process {X'J satisfying E[(X'„f] = r(l -2d)/r(l -df. The AR coefficients {a'„] and MA coefficients 
{c'„} of [X'^} are given by 

, r(n - d)d , T(n + d) 

Y{n+\)T{\-dy " r(«+ l)r(J)' 

(see, e.g., Brockwell and Davis (1991, Section 13.2)). Notice that > for n > and a,', > for n > 1. Put 

Zoo 
_^^^cX„„ « = 0,1,.... 

Lemma 4.4. We have fi'„ - sm{nd)/{7i(n - d))for n = 0, 1, 

Proof. Using the hypergeometric function, we have, for n > 0, 



, lyn-aja -^lya + v) lyn-a + v) lyn + i) i lyn-aja 

^" " T(n+ l)r(l -d) r(d) Tin - d) ' r(n + 1 + v) ' ^ ~ Un + l)r(l - d) ' " ' 

r(n - d)d r(n + 1) sin(nd) 1 



r(« + i)r(i -t/) r(n + I - d)r(i + d) n n-d' 

as desired. □ 

Proposition 4.5. There exist a real sequence {5„)JJlj and M e (0, 00) such that /3„ = /?^,{1 + S„} and |5„| < Mn^'^ for 
n e N. 
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Proof. By Inoue (2002, Lemma 2.2), we have, as n — » oo, 

= («-'), ^ = ^— + o(n-'), 4T- — + 0(n-'), 4t = — + 0(n-'), 

n''-! r(^^) ^ KiT{-d) ^ ' n''-^ r(d) ^ ' n''-^ T(-d) ^ ' 

where A"! :— 6{l)/(p(l) > 0. Hence we may write c„ = {Ki + 5„)c,' for n > and a„ = {(l/Ki) + t„]a'„ for « > 1, where 
{s„] and {tn] are sequences satisfying |5„| < L/(« + 1) for « > and |r„| < L/« for « > 1, for some L € (0, 00). 
We have, for n - 1,2,..., 

Zoo ^ — 1 00 ^ — 1 00 

From c'„l{n + 1) ~ \ I {rp-^''Y{d)] as « — > 00, we see that 

V°° II'' ^ f V°° ' ', V°° 

Hence, using ~ constant ■ n"'^'^''* as n — > 00, we get Yj7=o l^vl'^'v'^'n+v - O (n"*'^''') as n — > 00. Similarly, as n ^ 00, 
Combining these and yS^ ~ tt ' sin(7rc/) n we obtain the proposition. □ 



Proof (of Theorem|43J. By Theorem 12. II the Verblunsky coefficients {a(n)) of {X„\ and {a'(n)) of {X^) admit the 
representations a{n) - Yuk^x (^2k-iin) and a'(n) = Y^T^i ^2k-i^^^' respectively, where a2k-ii-) are those defined for {X„] 
in §2, while <3'2H^') '■^^^'^ counterparts defined for {X'„}, that is, a'^(n) - /3'„ and, for k - 3,5, ... , 

Zoo \ ^ CO ^ ^ ^ ^ 

mi={) ' ' ' Z_imi-i=0^"+'+"'i^"+'+"'i+"'2 ' ' ' Pn+\+mk-2+mt-fin+ini_x ■ 

York en, we define T2H e (0,oo)byT2n := {2k-2)\l{n2^''-\ik- l)!)2(2fe - 1)], or by 

J T"2i-ix^*"' = tt"' arcsinx, \x\ < 1 (4.1) 



(see Inoue and Kasahara (2006, Lemma 3.1) and Inoue (2008, Section 5)). Let M be as in Proposition 14.5 1 and let 
r > 1 be chosen so that sin(;7rii) < 1. Then, as in the proof of Inoue and Kasahara (2006, Proposition 3.2), there 
exists an integer independent of k such that 

1 + {Mil/) < r, a'nk-M) < -{r sin(7Td)f'''^T2k-i , n>N,k>\. 

n 

By Propositionl431 we have ^„+,,| < (l + Mn'''^/3'„^^. and ^„+,, - y6;,+J < Mn'''/3',j^^ for n > 1 and v > 0. We also have 
(1 + jc)*" - 1 < kx(l + x)*" for X > 0. Hence, for n>N, 

ZOO ■^—1 CO 

mi=0 £. — im2=0 /(TiT/zq 

< Mn-'' {(1 + Mn-''f + (1 + Mr-'') + l]a\{n) = {(1 + Mn-^ - l} a'^(n) 

< 3Mn-''(l +Mn-''fa'^{n) < 3Mn"<''+'V^ sm(nd)fT3- 

In the same way, \a2k-i{n) - a2i-i(")l - - l)Mn'^''^^^r^ sin(7rc/)}^*''T2A._i for A; = 1,2,... and n> N. 
Since a'{n) = (i/(n - d) (see Hosking (1981, Theorem 1)), it follows that 

- ^ - TjZi ^''^K-iin) - a2t-i(«)l ^ «"<'^"m2J^^(2^- l)T2k-i{r^ sinindyf'-K 

By (HD, we have 2^=1(2'^ - l)T2k-i{r^ sm{nd)}^''-^ < 00, so that 

a(n) = ^ + O (n-'-'+'n = - + O , n ^ 00. 

Thus the theorem follows. □ 
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